FACItlTV FORM 492 


NON-GAUSS1AN NOISE 


by 


Kursad Fevzi Tuncer, B.5. 


A Progress Report 
Submitted to 

i^atignal Aeronaytigs and Space Administration 
Washington, D. C- 

/i&R 

NASA Research Grant 19-003-Q03 


Electrical Engineering Department 
Louisiana Polytechnic Institute 


i ^ 

May 1970 

N70 -31870 

i (ACCESSION NUMBER) 

(THRU) 

\ 

(PAGES) " ' 

Wc3<30 

(CODE) 

07 

(NASA CR OR TMX OR AO NUMBER) 

(CATEGORY) 






N0N-GAUSS1AN NOISE 


by 

Kursad Fevzi Tuncer, B.S. 


A Progress Report 
Submitted to 

National Aeronautics and Space Administration 
Washington, D. C. 

M- 

NASA Research Grant 19-003-003 

Electrical Engineering Department 
Louisiana Polytechnic Institute 


May 1970 



ABSTRACT 


Non-Gaussian noise is the subject of this study. The probability density 
functions for quantization noise, continuous wave interference, atmospheric noise, 
and impulse noise are presented and discussed in detail. Impulse noise is described 
by the hyperbolic and Pareto distributions and quantization noise is represented by 
the uniform error distribution. Both the continuous wave interference and atmo- 
spheric noise follow Rayleigh and lognormal distributions. 



FOREWORD 


This thesis attempts to satisfy a need which has become apparent in recent 
years with the development of data transmission systems. This nee'd is for a pres- 
entation of types of noise which are not described by a Gaussian process. Though 
most of the results obtained here have appeared elsewhere and have become well 
known in recent years they have not been classified and discussed as to their 
probability density functions. Thus, all types of noise discussed here have in com- 
mon the probability density functions which are not Gaussian. However, old and 
well-known topics such as multipath interference and atmospheric noise are very 
closely related to the Gaussian process. These topics were included here because 
under transformations they cease to be Gaussian. For example, the Rayleigh dis- 
tribution is a non-Gaussian distribution which has Gaussian orthogonal components. 
Also, the lognormal distribution of atmospheric noise amplitudes is a non-Gaus- 
sian distribution. It is obtained by the transformation e^, where ^ is a Gaussian 
random variable. On the other hand, impulse noise is in no way related to the 
Gaussian process. Hyperbolic and Pareto distributions were used to describe the 
behavior of impulse noise. Another type of noise which is not related to Gaussian 
is quantization noise in PCM and which has uniform distribution. It is a fact that 
non-Gaussian noise occurs often in data transmission. Non-Gaussian noise is 
thus important because the usage of data transmission techniques is extensive and 
rapidly increasing. 
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INTRODUCTION 


Noise can be broadly defined as any unwanted disturbance within the use- 
ful frequency range. It is distinguished from distortion in that noise is a random 
process. 

One can classify noise into three categories in the frequency domain. Two 
of these are single frequency noise and impulsive noise. Between these extremes 
lies Gaussian noise. Naturally, the most commonly encountered noise is Gaussian. 
This distribution results where the noise is the sum of many independent noises with 
similar statistical characteristics as predicted by the central limit theorem. Exam- 
ples of Gaussian distributed noise are thermal and shot noise. However, types of 
interferences encountered in data transmission, such as quantization noise in Pulse 
Code Modulation (PCM) and impulse noise in telephone channels, do not follow 
Gaussian distribution. The same is true for atmospheric noise produced by thunder- 
storms. The non-Giaussian probability density function is encountered when radio 
waves at medium range of frequencies are scattered by the ionosphere and then 
interfere with the direct wave. 

Another way of classifying noise is to compare how if behaves with the sig- 
nal strength. For example, impulsive noise peaks in data transmission caused by 
"hits 11 and "dropouts 1 ' are often multiplicative in character. That is, noise multi- 
plies the instantaneous value of the signal wave amplitude by some function. 

Thus, multiplicative noise modulates the signal. Usually the multiplying function 
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mentioned is 1 and sometimes 0. ^ On the other hand, there exists additive noise, 
and the effect of this type of noise is reduced by an increase in signal strength. 

impulse noise is characterized by non-overlapping transient disturbances in 
the time domain. Common sources of impulse noise in wire transmission are dirty 
switch contacts, defective filters in power supplies, crosstalk through coupling from 
signaling circuits, improper shielding and grounding, unbalanced circuits, ignition, 
loose connections, etc. This type of noise is also caused by external or directly 
connected selector switches in telephone channels. Therefore, during the busy 
hours of telephone communication impulse noise is increased since switching is 
increased. However, impulse noise is not so disturbing in voice or continuous 
communication systems. But, in data transmission systems when the noise pulse 
has high amplitude, so that it can become comparable in magnitude with the thres- 
hold level. It can eliminate or add bits of information which are not present in the 
original signal. If the impulses occur very frequently, then they can become 
disturbing even in voice communication. 

In PCM systems, even when impulse noise is not present, there is an inher- 
ent noise existing. This is quantization noise and it is caused by the random dif- 
ference between the actual waveform and the quantized approximation. It is clear 
that quantized noise may be minimized by using as many quantized steps as possible. 
But this decrease in the noise is accomplished at the expense of increasing the num- 
ber of code pulses required to transmit a signal sample. 

In Chapter 3, an example of continuous wave interference is discussed where 
the sky wave is scattered ?n the ionosphere. Scattering of waves is caused by the 
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inhomogeneities of index of refraction which results from the turbulence in the at- 
mosphere. The scattering becomes more pronounced when the wavelength of the 

signal is of the same order of magnitude as the dimensions of the atmospheric 
o 

"blobs". When the scattered signal, as it is picked up by the receiving antenna, 
interferes with the ground wave, the result is fading. In other words the resultant 
wave has fluctuating parameters. Due to the fact that this fluctuation is not Gaus- 
sian, it is discussed in this presentation. 

Atmospheric noise, like impulse noise, often has impulsive character in 
the time domain. Atmospheric noise is caused by lightning flashes, which radiate 
electromagnetic energy. It may produce an electric field in the ionosphere much 
greater than 0. 1 v/m and a magnetic field which is comparable to that of earth's."^ 
These fields may, in addition to the direct interference, play an important part in 
the mechanism of reflection of signals from the ionosphere, at points close to the 
flash. This is so because absorption characteristics are altered by the presence of 
the fields. Ultraviolet light, which causes ionization in the ionosphere, also 
causes a change in the absorption characteristics of th'at medium. This is shown 
in Figure l. 5 

It is obvious from Figure 1 that at night, when electro'n density is less, 
absorption is less. Thus, atmospheric noise by being subject to propagation condi- 
tions just like any other EM wave, causes more direct interference at night. This 
is because noise can propogate long distances without being absorbed by the ionor' 
sphere. However, at higher frequencies this daily situation is somewhat reversed. 
At high frequencies, the ionosphere will support propagation only during the day- 
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FIGURE 1. Electron density in the ionosphere 


light hours. At night when absorption is low, the wave penetrates. In addition 
to the daily cycles there are seasonal variations in the frequency of occurrence of 
thunderstorms, which is a common experience witnessed by everyone. 




Chapter 1 
IMPULSE NOISE 

Errors tn data transmission do not follow the laws of purely random events.^ 
That is, Gaussian noise, which is purely random, does not describe the random 
process in this case. A characteristic of a Gaussian noise process is that it tends 
to deliver energy at a uniform rate.' 7 '® But a noise process delivers energy at a 
uniform rate if its standard deviation O' is very small. Obviously, impulse noise, 
as its name suggests, is impulsive in its character. This means that deviations in 
amplitude from the mean are highly probable or o is large. Then, it does have 
less uniform noise power and the process is considerably different from the Gaus- 
sian. 

One way to describe errors is to find their amplitude probability density 

function. Another way is to find the error occurrences in the time domain. Error 

occurrences can be described either by a distribution of error rates measured in 

small fixed time intervals or by a distribution of inter-error spacings. In any of 

the cases different distribution laws are obtained for short-duration and long- 

duration tests. ^ However, qualitative descriptions of errors in telephone circuits 

show that they appear to be comprised of bursts of errors, in fact, bursts of bursts 

in 

of errors in addition to single, independent error events. I(J 

The distribution for the amplitudes of impulse noise follows an empirical 
higher order hyperbolic law. 


5 
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Namely, 

p (n) = k/(n + b) 1 (1.1) 

where 

(n) is the amplitude of impulse noise, 

(k) is the constant to be determined, 

(m) is the order of the hyperbolic equation, 
and (b) is an added small constant (bias) to keep the frequency of 
occurrence of smallest amplitudes finite. 

If P (n) is defined as the cumulative’ probability of amplitude being n or 



Equation (1. 1) becomes 

p (n) = mb m /(n + b) m + 1 (1.3) 

and (1.2) becomes 

P (n) = b m /(n + b) m (1.4) 

The average of n is easily obtained by 

n = J°° n p (n) d n 
. o 

= m b m n/(n + b) m + ^ d n 
= b/m - 1 


0.4.1) 
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similarly 

n rms = " 2 PW d n 

“ 2 b 2 / [(m - .1) (m - 2)] (1.5) 

It is observed from (1.5) that for m = 1 or m = 2, n 2 ms ' s not Since 

p (n) in (1. 1) is Higher order hyperbolic, i.e. mV 1, then m > 2 is necessary. In 

12 

fact, 2 < m ^ 5 is the range of m. 

The plots of the cumulative distributions of the amplitudes of impulse noise 

for different m = 3,4,5 are shown and compared with the Gaussian and Rayleigh 

13 

distributions in Figure 1.1. ° Bias b = 1 is assumed. 
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It is seen from Figure 1. 1 that at low probabilities, the hyperbolic distri- 
butions show much larger amplitudes than do the Gaussian or Rayleigh distributions. 
Also, the root mean square value for the hyperbolic distribution is meaningless if 
b and m are not known, whereas in the Gaussian distribution the root mean square 
value is obtained directly by measurements of the amplitudes. 

It is proposed that the distribution of error rates, measured in long duration 
tests follow the first order hyperbolic law. ^ That is, putting m = 1 in Equations 
(1 . 3) and (1 . 4) gives 


p (n) = b/(n + b) 2 

0.6) 

p (n) = b/(n + b) 

(1.7) 


It is observed from (1 .4. 1) that n has no finite long-time average for m = 1. 
However, by running the integration to a finite boundary it is possible to derive a 
long time average. Thus 

n a = n P (n) d n / . (1-8) 

where subscript "a" in "n denotes the upper limit of integration. Equations 
(1 .6) and (1 . 8) give 

r» a = £ [n b/(n + b) 3 ]d n (1.9) 

Let v = n + b and y = a + b in (1.9). Then 

n a = bjj^0/v) d v - b 2 Jj^(l/v S ) d v (1. 10) 

or 

n a = b [in (y/b) - 1 + (b/y)] 

Let q express a quantile boundary. That is, the upper limit of the integra- 


tion in (1 . 10) is y = qb. 
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Then 

% = _ b[lnq - 1 + l/q] 
or 

n a = b[f(q)] (l.H) 

where F (q) = inq - 1 + l/q and it is a numeric which relates the long-time aver- 
age n Q to the bias b. Now, (n) is no longer continuous by definition. Then it is 
possible to find the probability of exactly (e) events having the long time average 

V 

That is, 

P [ 6 ' "a] = ^ b// ^ n + d n 

= b [l/(e + b) -1/(e + b+l)] 

“ 1 

= b/[(e + b) (e + b+ 1)] (1.12) 

Replacing the value of b in (1. 12) from (1.11) gives pj^e, n Q ^J in terms of the long- 
time average n Q . Thus 

p e, n a = n a (f)/ (ef -t n a ) (ef + f + n a )], 
and let e = 0,1,2 etc. 

p[ 0 ' "c] = f /( f+n a) 

P [l / n a ] = n a (f)/Q(f + n Q ) (2f + n Q ) ] 

P [2, ri a ] = n a (f)/ [(2f +"n a ) (3f + n a )J , etc. . 

These probabilities for different e, have been plotted in Figure 1.2, with 

q= 1000. 15 ^ 
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To find the probability of at least e events having the long-time average 
n a one proceeds as follows: 

co 

P ( e / n Q = S e b/(n + b) 3 dn 
= b/(e + b) 

and again using (1. 11) one gets 

P (e, n a ) = n a / (ef + n Q ) 

Plots for q = 1000 and different e are shown in Figure 1.3 and compared 
with the Poisson distribution. ^ 

It 5s observed from Figure 1.3 that Poisson probabilities are higher than 


the hyperbolic toward the larger n Q . 




FIGURE 1.3. Cumulative error density distribution 


Now, it is of interest to find the cumulated number of error-free intervals 
Having lengths (u) or greater, u is the interval duration with the same units as that 
of the test time T. 

Consider Equation (1 . 12); here the bias b has a fixed value. However, the 
amount of bias necessary is proportional to the interval duration u, i.e. , b = b a u. 
Then letting e - o and replacing b by b x u in (1 . 12) one obtains 
p (ff a , o, u) = 1/(1 + biu) 
or if b Q = l/bi 

p (n a , o, u) = + u) (1 . 13) 
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Now, p (n a , o,u) represents the fraction of “the total number of intervals of 
duration u in the test that contain no events. If u is allowed to vary, then the total 
time dT devoted to event-free intervals of length between u and u*t*du is given by 
dr = -T^d/du p (fT a , o, u)Jdu (1. 14) 

where T is the total test time. The negative sign is used in (1. 14) because p dimin- 
ishes as u is increased. From (1.13) and (1.14) one gets 
dr = |j b 0 /(b 0 + u) 3 Jdu, 


or 

dT/u = 0/y) jjT b Q /(b 0 + u) s Jdu . 

At/ u is the number of error-free intervals in du. Thus, 'when u varies from u 

i 

to infinity the cumulated number of intervals M(u) is given by 


- n 00 r 

M(u) .= J u (1/ v) It b 0< /(b 0 + v) 


d v 


M(u) = T 


- 1 + 1 In bo+u 


^o +u 


Thus far only the experimental results obtained from long-term tests were 
stated. It is now of interest to find the inter-error spacings for short-time tests. 

The distribution describing this case is called the Pareto distribution. ^ The Pareto 


distribution is a hyperbolic distribution without bias and of order m, where m is a 
parameter varying with the overall density of error incidence. - Namely, 

Q(u) = u" m (1.15) 

where Q(u) is the probability of an interval of at least u. The interval from one 
error to the next is u. Distribution (1. 15) plotted with logarithmic coordinates is 
shown in Figure 1.4. 
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If the number of errors in the test is N, then the probability of the single 
longest error u Q is 

Q(u 0 ) = 1/N . 

This is shown in Figure 1.4. 

Since there are N errors and therefore assuming N-l ** N intervals one 
can redraw Figure 1.4 in a linear scale with N discrete steps. Let the ordinate 
Q(u) be replaced by NQ(u). Then each unit step in the scale represents one inter- 
val between errors. This is shown in Figure 1.5. 



FIGURE 1.5. Linear plot of interval distribution 
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In Figure 1.5 the s interval u g has the probability 


Q(u s ) = s/N 

(1.16) 

Equation (1. 15) also gives Q(u s ) as. 


Q(u s ) = u s - m 

(1.17) 

Then from (1 . 16) and (1 . 17) 


= (N/ s .) 1/m 

(1.18) 


Considering Figure 1.5, the total test duration T is equal to the sum of all 


the intervals u. 
Thus 


T = Ux + Ug + U3 + . . . -f u s . . . + u Q 
Then making use of Equation (1.18) 


7 = fs|V m 


(1/1) 1/m + (1/2) 1/m + . . . (1/s) 1/m . . . + (1/N) 1/1 

18 


m 


(1.19) 


The expression in the brackets in (1. 19) is called the zeta function. 

Z (N, P) = ** (1/s) P 

s= 1 


( 1 . 20 ) 


where p = l/m. 

19 

Tables and graphs are given for the zeta function (see Appendix 1.1). 

Now, once Z(N, p) is computed the test duration T can be found by 
T = N 1 /" 1 Z(N, 1/m) . 

Now consider an ensemble of tests, each of duration T bits, but having a 

different number of errors Nj. In general, the longest spacing u Q . in each test will 

* 

be shorter when there are more errors or longer when there are less errors. This is 
illustrated in Figure 1.6. 
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FIGURE 1.6. Variation of maximum interval (u Q ) 

It is also seen that the magnitude of the slopes (-mj) increases with the 

increasing number of errors Nj. A better plot showing the relation between the 

20 

slopes m and number of errors N for a given test time T is shown in Figure 1.7. 



FIGURE 1.7. Variation of order (m) with error incidence 
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If one determines m from Figure 1.7 for a given number of errors N and te:>t 
time T, then it is possible to obtain another plot showing maximum inter-error 
interval u Q . This is shown in Figure 1.8. 



FIGURE 1.8. Variation of Maximum interval with error incidence 


It is observed from Figure 1.8 that the maximum intervals show a faster drop 
over a narrow range of errors. However, it is noted that this rate of fall is inde- 
pendent of test duration time T. 




Chapter 2 

QUANTIZATION NOISE 


Quantization noise is a form of distortion due to "rounding-off 11 or quantir 
zation of a continuous signal into discrete steps. However, the quantization process 
allows digital encoding which is a very desirable data transmission technique be- 
cause of its ability to combat the effects of noise. In PCM, a major source of error 
is due to quantization. 

21 

The typical quantized transmission scheme is shown in Figure 2. 1. 



Filter Quantizer 



CODER 


♦ 

IDEAL 

CHANNEL 


FIGURE 2.1. Quantized transmission scheme 


Let the signal to be sampled and quantized be represented by s(t) and the 

sampling wave as £ 6 ({■ - k Tj - t). 
k 

This is shown in Figure 2.2. 
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FIGURE 2.2. (a) Sampling of the signal 
(b) Impulse train 


T is the timing phase and it is uniformly distributed- over the interval o T ^ Ti . 

t 

s(t) can be represented with the pulse trains after sampling, compression, 

quantization and expansion, in that order-. Thus, if s (kT^ +T) is the sample value 

of s (t) at time kTi + T t then one obtains 

£ s(kTi + f) 6 (t - kTi - T) as the sampled signal, 
k 


S s r>(kT x + t) 6 (t - kTi - t) as the sampled and compressed 


k comp 


signal. 


S s (kTi + T) 6 (t - kTx - T) as the sampled, compressed and 
k com P quantized signal, and 


STs (kTi + T) 6 (t - kTi - T) as the sampled, compressed, 

^ comp exp quantized and expanded signal. 

If F(s) is the compandor (in this case compression) characteristics, then , 

F(s) = F^s(kTi +r)J= s C omp(kTi + T ) ‘ s compressed sample value and§ com p(t) 

is one of the (2 n - 1) quantized levels that the quantizer output approximates for 



s (t). Similarly F” 1 s‘__ rnr .(kTi + r) = + r ) ovri 

comp' ' comp' L com P exp 


Note that from Figure 2. 1 the signal entering the expandor is already 
quantized. 

At the input of the low-pass reconstruction filter the impulse associated 
with time t = kTi +■ T is 

[W< kT ‘ +T >]exp 6 < t - kTl - T > 

and the area of this impulse can be expressed as 

[ J co m p< kT > + r >]exp = s(kTl + T) + E (kTl + T) ' (2 ' ]) 

e(kTx +T) in Equation (2. 1) is the quantization error defined in an interval 
( - A/2) £ e(kTi + t) £ A/2 as shown in Figure 2.3. 



e(kTx + r) is also the sample value of e(t) at t^ = kTx + T. 

When companding is present the quantization step size A varies according 

to the companding characteristics F(s). But since s = s(t), a function of time, then 

F(s) and A would be functions of time. For A(t) one has 

_ Auniform 

F" s(t) 
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where F / (^s(t)J, in this case, is the derivative of the compressor characteristics 

23 

and is evaluated at that input amplitude of the signal at the time of the sampling. 

To find the quantization noise ®(t) a t the output of the reconstruction filter 
one proceeds as follows. Let 

-[W f >]e*p- s W (2 ; 2) 

where j^ Comp (t)J ex p is a compressed, quantized and expanded continuous signal, i.e. 
defined at any time t. This signal is obtained by passing j^p com p(kTi + t)J exp ^ 

(t - kTi - T) through the low -pass filter with the transfer function TiG 2 g(w), whefe 


(2.4) 


Ggg is the gate function with bandwidth 2B. Thus, one obtains (see Appendix 2. 1): 

[W»] exp - + *] exp Sa [ B <'- kT ' - ’J] < 2 - 3 > 

Simi larly s(t) is obtained by reconstructing it from its samples s(kTi + t). 

s(t) = £ s(kTi + r) So[b(T - kTi - t)] . (2.4) 

In Equations (2.3) and (2.4) Sajli(t- kTi - T)J is equal tojsin B(t - kTi-r)j / 
B(t - kTi “ t ) and is called the sampling function. Now, replacing^ com p(t)J ^ 
and s(t) in (2.2) by their equals in (2.3) and (2.4) one obtains 

E(f) “ j<f[W kT l + T) ] exp - =< kT ' + T D & B <» - kT * - T > <2-5) 


s « = l [pcomp< kT ' + T >] exp ' s(kTl + 30 B < 1 - kTl * T > 

or by making use of Equation (2. 1) 

e(t) = £ e(kTi + T) Sa [B(t - kTi - T)] . 

From Equation (2.5) one can obtain e 2 (t) (see Appendix 2.2) to be 

- WT ?{[W kTl + T)] exp - s(k Tl + r)J 2 


(2.5.1) 


( 2 . 6 ) 
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Now, T is the interval over which averaging is performed and f s is the signal 
frequency. But, since according, to the sampling theorem the minimum sampling 
rate must be 2f s , then 2f^T is the total number of samples in the interval T. 

Therefore the right hand side of Equation (2,6) is nothing but the mean 
square value of the samples at times t^ = kTi + T, Therefore, 


« a 0) = e s (kTi + t) . (2.7) 

It is seen from the equality in (2.7) that the problem of finding ® 2 (t) is 
merely reduced to finding e 2 (kTi + T) of the band limited signal s(t). This can be 

A i 

found from the following argument. 

The quantized levels are 6 volts apart and e (kTi + t) must lie in the range 
£-A/2, A/2^, where the midpoint of quantized interval is taken as reference. The 
amplitude distribution of the signal. s(t) is assumed to be uniform in the range 
[o, (M-l) Aj, where M is the number of quantization", levels. Thus, the distribu- 
tion of e(kTi + t) will also be uniform in the range j[-A/2, A/ 2 J. The probability 
density function for ejkTi + t] would be. 



, [-V2, 4/2] 

1 0 

, otherwise. 


P [ e (kTi + r)] = 

Then, the mean square value of e(kTj 4- T).can be found by 


® S (kTi +t) = J e ’ 3 (kTi + t) p [e(kT x + r)] d [e(kT x + r)] 
= tJ' A/ 2 * 2 (I<T 1 +T)dj>(kTi+T)] 

= A 2 /12 


Therefore, from Equation (2.7) 
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e s (t) = t? /\2 (2.8) 

Equation (2.8) represents the quantization noise power at the output of the 
reconstruction low-pass filter. 

The upper bound for this error can be found by applying the bounding tech- 
nique of Chernoff."* This bounding technique states that if a probability density 
function p (x) has a moment generating function M (v), then 

J C °p(x)dx^M(v)e" va (2.9) 

a 

where a is a constant. 

Now, e(t) as defined in Equation (2.5. 1) is the sum of uniformly distributed 

o 

4 

functions. Thus, applying the Chernoff bounding technique to uniformly distributed 
functions one gets 


[ M (v)] unjf =[sinh v(V2)]/v(A/2) 


CO r 


= s 

h=o 


v(V2)P n 


'l/(2n+l)l ] 


( 2 . 10 ) 


* I 

One can find the characteristic function of the sum by obtaining the product 

of the characteristic functions of the individual sum terms.. 

Instead of going ahead and applying this statement to uniformly distributed 

variables an interesting fact will be derived. This fact is that the quantization 
© 

noise power e 3 (f) is also upper bounded by G(v)e -va , where G(v) is the charac- 
teristic function of the Gaussian process. For this to be true one must have 
G(v) s [M(v)] .p In fact this is true (see Appendix '2.3). 


G(v) = exp|jnv + v S cr 2 /2 J 


( 2 . 11 ) 
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where m, ct are the mean and rms values respectively. However, since e (t) was 
chosen to have zero mean and variance equal to A s /12, then in accordance with 
this one has m = o, 0 3 = A 2 /12 for the Gaussian process. This statement is justified 
since one is directly comparing e (t) and the corresponding Gaussian variable. 
Therefore from (2. 1 1): 

G(v) = exp [(A 3 / 12) (v 2 /2)] (2.12) 

One can now find the characteristic function of the sum by 
. k 

G s (v) = " G-(v) 

i=o 

where the subscript s in G s (v) stands for "sum", and from (2. 12) 

G s (v) = expjjk/2) (A 2 / 12) v 3 

Then 

G $ (v) e -va = expjjk/2) (A 2 / 12) v 2 - avj (2.13) 

In Equation (2. 13) v can be chosen such that this upper bound is minimized. 
Thus, this value of v is found to be (see Appendix 2.4): 

V = (q/k) <W/&) (2. 14) 

Placing the value of v in (2. 13) from (2. 14) one gets 
[ G s (v) e“ va ] m . n = exp[- (a S /2k) (12/A 2 )] 

The final result is obtained from (2.9) by placing exp {^— (a 2 /2k) ( 1 )]J f or 
M (v) e -av . Then, 

P [®0) > a l ^ expj^- 6a S /kA 2 J . 



Chapter 3 

AN EXAMPLE OF CW INTERFERENCE 


Continuous wave interference is in contrast to other types of noise dis- 
cussed, because they were impulsive and/or discrete time domain occurrences. In 
addition to this, it is assumed CW does not originate from a random source, but 
from a transmitter which transmits a deterministic continuous carrier wave. 

However, an uncertainty is witnessed at the receiving end. This is, among 
other factors, due to scattering of the transmitted wave which takes different prop- 
agation paths to reach the receiving antenna. The probability density functions 
obtained to describe this uncertainty are very much the same as for the atmospheric 
noise. ° This is the main reason CW interference is discussed here along with 
other non-Gaussian disturbances. However, CW interference differs from atmos- 
pheric noise, in addition to the differences described above, in that it does not 
add noise power to the signal. 

A probability density function for the resultant wave is to be found. The 
resultant wave is obtained by the sum of the direct wave and the wave reflected 
from the ionosphere. The direct wave will have amplitudes defined by^' 


S Q = exp 


- S 6.d. 

L J-i J J . 


(3.1) 


This is the equation describing the attenuation of a wave due to the pene- 
tration of a wall or other obstacles where 
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dj is the thickness of the jth obstacle 

6j is the attenuation caused by that obstacle. 

The distribution of S &d. is found by applying the central limit theorem 
j= 1 J J 

• • * OQ ^ 

and if is Gaussian. By a transformation of variables using (3. 1) one obtains the 
probability density function for the amplitudes S Q (see Appendix 4.2) 


P (SJ = 


$o °V 2TT 


exp 


j“ , (InSp - m) a j 


(3.1.1) 


This is called the lognormal distribution. The phase of the direct wave is 
assumed to be uniformly distributed at the receiving end.^ 

The sky wave is scattered at the ionosphere before it is reflected back to 
earth's surface. This well-known scattering problem will yield a waveform des- 
cribed by a Rayleigh phasor<. That is, this wave will have a Rayleigh amplitude 

OA 

distribution and uniform phase distribution. A Rayleigh phasor has Gaussian 
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orthogonal components. 

The resultant wave will also have uniform phase distribution due to the 
fact that one has the sum of uniformly distributed phasors (see Appendix 3. 1). 

The problem to be solved in this chapter is to find the amplitude distribution of 
this resultant wave. Thus, the problem is stated as fallows. Let the received sig- 
nal be 

i = S Q e J6 ° + Si J 01 (3.2) 

where 

S, Sqt Si are the amplitudes of the resultant, direct,, and reflected waves 
respectively. 0, 0 Q , 9i are phases of these waves. Now, the probability 
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density function p(S) is to be found. Figure 3. 1 shows the phasors in (3.2) 



To find the distribution of S, first the conditional distribution P C (S) = 
p(S/S Q ) is found and then the application of the theorem of total probability 
yields p(S). Thus, S Q is held constant for the moment. Also, to make the cal- 
culations easier 0 O will be assumed a reference phase. This assumption merely 
tates x, y to put S Q on the x-axis. Physically this may be achieved by some 
arrangement of phase-lock system.^ Then the components of sei® are 
S x = S 0 + Si cos 0i 
Sy = Si sin 0i 

if was stated earlier that Sie® 1 is a Rayleigh phasor and has Gaussian 
components. Therefore, Sicos0i andSisin9i are Gaussian. Then, 

P(5y) is Gaussian from (3.5) and 

p(S x ) is also Gaussian but shifted to the right by S Q in (3.4). 

The joint distribution of S x and Sy is given by 

P(S X , S ) = _L exp I" "( S x - s q) 3 » iy! 1 , 
f r a L ct a J 

where a — 2cr S . 


ro- 


( 3.4 

(3.5) 


(3.6) 
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Equation (3.6) is transformed into polar coordinates by 

p c (s,6) = (S) p(S x , Sy) 

where 


p_ (S,0) is the conditional probability. 


$ x = ScosQ, 

Sy = Ssin,0' and 
S 3 = S x 3 + Sy 2 . 


Thus 


p c (S,G) = -5- eXp |j" +S o) S + (2SS n cos6) j 

One can now obtain p c (s) = p(S/S Q ) from (3.7) by 
P C (S) = P c (S, 0) d0 


= S -(s!+s 0 3 )/a r^SSo/a) cose 


=^e . t "O 

T la 


{' 


:de. 


But J^So/alcosejg = i a (^j ; 


I 0 (x) is modified Bessel function of x. 

Then equation (3.8) becomes 

Pc(S) - |[ e -(S^S 0 V“]l 0 (2| 2 ). 

Applying the theorem'-of total probability to (3.9) one gets 
P(S) = P C ( S ) P( S o) dS o 
or by replacing p c ($) from (3.8) and p(S 0 ) from (3. 1. 1) 


p(S) = 


2S/2 
aj aTT J o S 0 




(3.7) 

(3.8) 

(3.9) 
(3. 10) 
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The evaluation of this integral is difficult. However, the following 
practical results are obtained: 

Case 1 . 


If S and S Q are much smaller than the rms value of $, then 



approaches unity. 


Thus, from Equations (3.9) and (3. 10) one 


gets 

p(S) = 25 -S7« j“p(S 0 )dS b 

a e ° 


p(S) = — 0 -S 2 /® ifS o > 0foralI time. 

This is the Rayleigh distribution. 

Case 2. 

A somewhat more difficult argument is foliowed-to obtain p(S) when S 
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/a . The result is that, (3. 10) approaches p(S Q ) given by (3. 1. 1). in other 
words, p(S) becomes lognormal ly distributed. 



Chapter 4 

ATMOSPHERIC NOISE 


The lightning discharges in storms all over the world are the main cause 
of atmospheric noise. The model that will be proposed here does conform with the 

qc 

experimental results plotted in Figure 4.1. 3 



p [nAn.s > Rj% 

FIGURE 4. 1. Amplitude distribution of atmospheric 
noise plotted on Rayleigh paper. 
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Distributions approach Rayleigh for small amplitudes (high probabilities) 
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and lognormal for large amplitudes (low probabilities). A lightning discharge is 
transmitted by radiation and therefore superposition applies at a particular point or 
time. For example, atmospheric noise is the sum of all the other atmospherics 
propogated to that point. The model proposed here describes each atmospheric 
as upsurging and decaying exponentials in time. ' This model is shown in 
Figure 4.2. 



If (rip) 0 is the peak value of the atmospheric received at time t Q and a 
is the exponential decay time constant, then the atmospheric n Q (t) is given by 

„ o([ ) = 

((np) 0 exp for t < t 0 . 

For t < t Q , 0 is the rise constant. 
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The amplitude of the k^ previous atmospheric at time t 0 is given by 

n k = (n p ) k e“V* 

At a particular time t Q the total atmospheric noise is 

03 <X> 

neJ^ = n eJ^ 0 + S nuej^k + 2 (n\ eJ^ (4.1) 

° k=l K k=l 

where (n*) is used for upsurging atmospheric. 

Since t^, shown in Figure 4.2, is a random variable, the phases of the at- 
mospherics at the receiving point are also random. Thus one has random phasors. 

In fact they are uniformly distributed and each component in (4. 1) is called a uni- 
formly distributed phasor (UDP)-^ 

Now, at any time t the atmospheric noise N(t), when the uprising atmoi- 
spherics are neglected, is 

N(t) = ne for t Q < t^ tx, (4.2) 

Here, it is assumed that there are no new atmospherics occurring in the time 
interval t, defined in (4.2). The next atmospheric occurs at t = tx . But In this 
time interval the total amplitude n is fixed by the set of atmospherics that have 
already occurred. Therefore, N(t) is a deterministic function of time. Conversely, 
if time is held constant and n varied randomly, then N will have the same distri- 
bution as for n, of course differing by a multiplication constant. 

The question arises as to what the distribution of N would be if N were to 
vary randomly, not at a fixed time chosen in the interval t Q < t < tx but throughout 
this interval. The distribution in this interval can be found once the conditional 
distribution at a given time is found. Then the. theorem of total probability is 
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applied to find the general distribution.^ However, no attempt is made here 
to find this general distribution because It is very involved. Instead, at a 
given time the cumulative distribution P(N/N rms > R) is found. Even before finding 
this, one must find the distribution of n which in turn is determined by the distri- 
butions of n , n^ and (n^. 

n Q has the same distribution as the distribution of the peak values (np) of 
the atmospherics but differing by a multiplying constant (see Appendix 4. 1). The 
peak values follow the field strength formula 


n p " 


k/T, 


•' n exp ( -2 S|d: ) , 
J= 1 J J 


where P n Is the peak power at a particular frequency. 


(4.3) 


d is the distance of discharge from the receiving point, in general 



K is a constant of proportionality, and 
6 - is the path of propogation of section. 


One can express Equation (4.3) as 
A 

n p = e 

where A = _i 6 d + 1/2 In P n + In K - In d . , „ 
j=l J J 


(4.4) 


All quantities in (4.4), except K, are random. Also the fluctuation in' the 
first term of A is more dominant. Thus the distribution of A would approximate the 

I I 

distribution of £ 6jd*. However, the central limit theorem applies to 2 6-d; 

j=] J J j=l J J 

which makes it Gaussian. Therefore, A J s Gaussian as well. 
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One can now find the probability density function of the peak noise ampli- 


tudes as (see Appendix 4.2) 


p( n p) = jV(n p ) exp 


[ln(np) - m]‘ 


The distribution described by (4.5) is called lognormal distribution. As was pre- 
viously stated, p(n Q ) differs from this distribution by a multiplying constant. 

Now, one must obtain p(n|<). From Equation (4. 1. 1) one has 

= u/v (4.6) 

where u = (np)^ and v = exp [jk/aJ. (4.7) 

The distribution of u is given by (4.5). However, before the distribution of 
v can be found the distribution of tj,. must be obtained. One way of finding pOjj) is 

to divide tu into k intervals of length T;, each having exponential distribution^'^ 
-At k 

Then, p(T •) = Ae - T and t^ = £ Tj where i = 1,2,3. ..k and A is the number of 
atmospherica per unit time. Now p(tk) is found by making use of these (see Ap- 
pendix 4.3), and 


p0]<) = _A k ^ e ^ l 


It is interesting to note that, one could have just as well obtained (4.8) by 

assuming that the number of atmospherics in a given interval is Poisson distributed. 

Then conversely, under this assumption, one finds the interval distribution given 
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the number of atmospherics in that interval. 

If one proceeds to find p(v) by using (4.7) and (4.8), (See Appendix 4.4), 


one gets 


A k °^ (In v)^ 1 

P( v ) “ (k-1) I Aafl 


(4.8.1) 
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Now, since the distributions of u and v are known, one can find the distri- 
bution of n k from Equation (4.6), (see Appendix 4.5). 


A. k o^ 


03 


zx * « r k-i 

p( " k) = (k-l)Teih[7B r J ° * exp 

where In v = x. 


■a\x- 


(In n k + x-m)' 

2CT 1 


d x (4.9) 


Returning to Equation (4. 1) one can prove (see Appendix 4.6) that. 


co 

2^ . ^ 2- 


0© 


<n*> = <n*>+£ <n k ->+ S <(O a >. 


k=I 


k=l 


(4.10.1) 


The mean square of n^ is given by: 


03 


<n k > = f 0 n k 2 PH) d n k 

Placing the equal of pfnp) in (4. 10) from (4.9) one gets 


(4. 10) 


<n k > 


kj< 


<30 VS-J 

= S- 3 


o " k (k-l)lan k /2iT i 


k-1 


exp 


-aXx - (innk+x-m) c 


2CT 


dxdnu 

(4.11) 


When the integral in Equation (4. 11) is evaluated (see Appendix 4.7) one 


gets 


X k G! k exp 2(o^ + m) 
Qa+ 2) k 


* (4.12) 

Also, consider the upsurging atmospherics (n^) attaining their peak values 

at a time t 0 -ft k . The second moment for this is obtained in the same'way as that 

for decaying atmospheric, except that the a time constant is replaced by ft. 

w exp 2(ff s + m) 

<lnW- > = C 

(X/3 + 2) k 

if one assumes at the time of observation that there are no upsurging atmo- 
spherics, then one can neglect <(n k ) 2> in Equation (4.-10. 1). This assumption is 



35 


especially true if the set of atmospherics is occurring away from the observation 
point. Now, replacing <n S> in (4. idll) by its equal in (4. 12) one obtains 


<n 3 > = 



(4.13) 


oo 

■ 5 I 

k=o 



k 

in (4. 13) is a converging geometric series which is equal to 

X(o/2) + 1. 


Equation (4. 13) becomes 

<n 2 > = [(Xq/2) + l] e^+m) ( 4 . 14) 

Case 1 

If Xq/2^1, then Xq/(Xo^2) will approach unity and the geometric series 
will thus tend to converge less rapidly. The first term <n^> in (4. 13) would 
be negligible as compared to the sum. 

In other words 

<n 2> « ,S <n, 2 >*W2) e 2 ^) . (4.15) 

k— o K 

From Appendix 4.6 

<n k > = <Q? n^e 1 ^) 2 > . (4. 16) 

The sum £ (ni j n (4. 16) has a Rayleigh amplitude distribution since it 

k=o K ' 

represents the sums of uniformly distributed phasors n^e^k.^ Consequently, for 
Xc/2»1, the random variable n will approach the Rayleigh distribution at time t Q . 
However, experiments have contradicted this result.^ Therefore, one rejects the 
possibility Xo/2 :s> l and seeks the possibility Xg/2^1. 
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Case 2 


od '*h M= 


If Xg/2'' < 1, then |<SoU.a+2 j will converge to 2/(2 - Xo). Since the 

first term is not negligible as compared to 2/(2-Xo), one cannot neglect any term 
in the sum (4. 13). From Appendix 4. 1, the distribution of n Q was found to be log- 
normal. Also, for the reasons stated in Case 1, n^e ^ is still a Rayleigh 
phasor. Then one has the sum of a lognormal and a Rayleigh phasor, the distribu- 
tion of which was derived in Chapter 3. Thus 


p(n) = 


(1/ncr/ 2lT)exp -(In n-m) 3 , forn^/K/T 

, "To 3 _ 


(2n/M) exp[-n 2 /M^] , for n <<: /m” 
where M = (oiX/2) e 3 . 


(4.17) 


As a final solution one uses (4.2) to find p(N) at a given time or more 
practically p^N/N rrns ^. It was said before that at any given time the values of 
N would differ from n by some multiplying constant C. Then 



N 

= Cn 



or 

<>0 =C 2 (n rms 2 ) 


and 

N/N rms = n/n 

'rms 

(4.18. 1) 

where 

n rms 

_ / 1+Xg/2_ 

3 

e a +m . 

(4.18.2) 


From (4. 

18. 1) one obtains 



pj^N/N rms J n rms p(n) 

(4.18) 


Equations (4. 17), (4. 18. 1) and (4. 18) are used to obtain 
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\wH r jcm exp {- 


ln(N/N rms ) + tf 3 

T~2 


cr 


P(N/N rms ) 


for n »7Mbnd Nj/N rms »Xa/2 


(4. 19) 




M 


»\ 

2 - 

■yexp 

- (H/N rms f " r " s 


for n < V'M~and N/N. ms ^ Xa/2. 


One can find the cumulative distribution P(N/N rms ) from (4. 19). It is also 


noted from (4. 18. 1) that P(N/N rms > R) = P( n / n rms > R) °nd is given by 

'In R + o? 
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. 1/2 


", t f\n R + c?\ 1 


P(H/N rms >R) = 


F 

exp jj-R 3 / (M/ n rms 2 )J , for R ^ Xa/2 


Note that M/ n rms 


= XOf/2 (Xor/2 + 1) . 



APPENDICES 
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Appendix 1.1 (Continued) 


Table 1 


INCOMPLETE ZETA FUNCTION Z(N,p) 


p = 0.100000, m — 10 


= 0.500000, m 


2 


Z(N,ff> 

NP 

N 

• Z(N,p) 

, NP 

1.933033 

1.071773 

2.00 

1.707107 

1.414214 

4.550882 

l. 174619 

5.00 

3.231671 

2.236068 

8.619334 

1.258925 

10 

5.020998 

3. 162278 

1.623687x10 

1.349283 

2x10 

7.595255 

4.472136 

3.730404x10 

1.478758 

5.10 

1.275237x10 

7.071068 

6.981874x10 

1.584893 

10 2 

1.858960x10 

1.000000x10 

1.305143x102 

1.698646 

2xl0 2 

2.685924x10 

1.414214x10 

2. 980869x1 0 2 

1.861646 

5xl0 2 

4.328328x10 

2.236068x10 

4. 036227x1 0 2 

1.925350 

7xl0 2 

5. 147344x10 

2.645751x10 

5. 565207x1 0 2 

1.995262 

10 3 

6.180081x10 

3. 162278x10 

1.03881 1x1 0 3 

2.138469 

2x1 0 8 

8.799798x10 

4.472136x10 

2. 370094x1 0 3 

2.343673 

5xl0 3 

1.399766xl0 2 

7.071068x10 

4. 423059x1 0 3 

2.511886 

10 4 

1.985553xl0 2 

l.OOOOOOxlO 2 

8. 254026x1 0 3 

2.692173 

2xl0 4 

2.813980xl0 2 

1.414214xl0 2 

1.882878xl0 4 

2.950509 

5xl0 4 

4.457689xl0 2 

2. 236068x1 0 2 

3.513606xl0 4 

3. 162278 

10 5 

6.310108xl0 2 

3. 162278xl0 2 

6. 556652x1 0 4 

3.389245 

2x105 

8. 929825x1 0 2 

4.472136xl0 2 

1.495648x10^ 

3.714471 

5x10^ 

1.412769xl0 3 

7.071068xl0 2 

2. 79098 lxl 0 5 

3.981072 

10 6 

1 . 998555xl0 3 

l.OOOOOOxlO 3 

5.208158x10^ 

4.266807 

2x106- 

2. 826982x1 0 3 

1.414214xl0 3 

1.188038xl0 6 

4.676242 

5xl0 6 

4.470691xl0 3 

2. 236068x1 0 3 

2.216958x10^ 

5.011872 

10 7 

6.323110xl0 3 

3. 162278xl0 3 

4. 136989xl0 6 

5.371592 

2xl0 7 

8. 942827x1 0 3 

4.472136xl0 3 

9.436923xl0 6 

5. 887040 

5xl0 7 

1.414069xl0 4 

7.071068xl0 3 

1.760992xl0 7 

6.309573 

10 8 

1.999856xl0 4 

l.OOOOOOxlO 4 

3.286128xl0 7 

6.762433 

2xl0 8 

2. 828283x1 0 4 

1.414214xl0 4 

7. 49601 5x1 O 7 

7.411344 

5xl0 8 

4.47 1992x1 0 4 

2. 236068x1 0 4 

1 .398806x1 0 8 

7.943282 

1 0 9 

6.32441 lx 10 4 

3. 162278xl0 4 
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Table 1 (Continued) 


p= 1.000000, 


m = 1 


p= 1.428561, m = 0 .7 


Z(N,p) 

np 

N 

Z(N.p’) 

NP 

1 . 500000 

2.000000 

2.00 

1.371499 

2.691800 

2.283333 

5.000000 

5.00 

1.818010 

9.9661 77 

2.928968 

1.000000x10 

10 

2.089265 

2.682696x10 

3.597739 

'2.000000x10 

2x10 

2.301445 

7.221281x10 

4.499205 

5.000000x10 

5x10 

2.506341 

2. 673622x1 0 2 

5. 187376 

l.OOOOOOxlO 2 

10 2 

2.617318 

7. 196856xl0 2 

5.878027 

2.000000xl0 2 

2xl0 2 

2.700206 

1.937250xl0 3 

6.792811 

5. 000000x1 O 2 

5xl0 2 

2.778246 

7.172514xl0 3 

7. 128992 

7.000000xl0 2 

7xl0 2 

2.800060 

1. 159914xl0 4 

7.485444 

l.OOOOOOxlO 3 

10 3 

2.819999 

1.930698xl0 4 

8. 1784 

2. 000000x1 0 3 

2xl0 3 

2.851059 

5.197053xl0 4 

9.0945 

5. 000000x1 0 3 

5xl0 3 

2.880221 

1.924167x10^ 

9.7876 

l.OOOOOOxlO 4 

10 4 

2.895803 

5. 179474xl0 6 

10.4806 

2.000000xl0 4 

2x‘10 4 

2.907381 

1.39421 lx 10 6 

11.3967 

5.000000xl0 4 

5xl0 4 

2.918252 

5.161955xl0 6 

12.0896 

1.000000x105 

10 5 

2.924060 

1.389495xl0 7 

■ 

2. 000000x1 0 5 

2xl0 5 

2.928376 

3. 740244x1 0 7 


5. 000000x1 O 5 

5xl0 5 

2.932428 

1.384795x10° 


l.OOOOOOxlO 6 

10 6 

2.934593 

3. 727593x1 0 8 


2. 000000x1 0 6 

2xl0 6 

2.936202 

1.003394xl0 9 


5. 000000x1 0 6 

5x10° 

2.937713 

3.714985xl0 9 


l.OOOOOOxlO 7 

10 7 

2.938520 

9.999996xl0 9 


2. 000000x1 0 7 

2xl0 7 




5. 000000x1 0 7 

5xl0 7 




l.OOOOOOxlO 8 

10 8 




2.000000xl0 8 

2xl0 8 




5. 000000x1 0 8 

5xl0 8 




l.OOOOOOxlO 9 

10 9 
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Table 1 (Continued) 


p = 2. 000000, m = 0. 5 


2.500000, m = 0.4 


Z(N, p) 

IMP 

N 

Z(N,p') 

IMP 

1.250000 

4.000000 

2.00 

1 . 176777 

5.656854 

1.463611 

2.500000x10 

5.00 

1.290065 

5.590170x10 

1.549768 

l.OOOOOOxlO 2 

10 

1.321921 

3. 162278x1°;? 

1.596163 

4.000000xl0 2 

2x10 

1.334307 

1.788854x10“ 

1.625132 

2.500000xl0 3 

5x10 

1.339629 

1. 767767x1 0 4 

1.634983 

l.OOOOOOxlO 4 

10 2 

1.340825 

9. 999999x1 0 4 

1.639945 

4.000000xl0 4 

2xl0 2 

1.341251 

5.656854x10^ 

1.642932 

2.500000x10^ 

5xl0 2 

1.341424 

5.590170x10^ 

1.643501 

4. 900000x1 0 5 

7xl0 2 

1.341446 

1.296418xl0 7 

1.643927 

l.OOOOOOxlO 5 

10 3 

1.341459 

3. 162278xl0 7 

1.64442 7 

4. 000000x1 0 6 

2xl0 3 

1.341472 

1.788854xl0 8 

1.644727 

2. 500000x1 0 7 

5xl0 3 

1.341478 

1. 767767x1 0 9 

1.64482 7 

l.OOOOOOxlO 8 

10 4 

1.341479 

9. 999998x1 0 9 

1.644877 

4.000000xl0 8 

2x104 

1.341480 

5.656853xI0 10 

1.644907 

2. 500000x1 0 9 

5xl0 4 

1.341480 

5. 590 169x10 11 

1.644917 

l.OOOOOOxlO 10 

10 5 

1.341480 

3.162279xl0 12 

1.644922 

4.000000xl0 10 

, 2xl0 5 

1.341480 

1.788855xl0 13 

1.644925 

2.500000xl0 n 

5xl0 5 

1.341480 

1.767767xl0 14 

1.644926 

l.OOOOOOxlO 12 

10 6 

1.341480 

l.OOOOOOxlO 15 

1.644927 

4.000000xl0 12 

2xl0 6 

1.341480 

5.656853x10 5 

1.644927 

2.5QOOOOxl0 13 

5xl0 6 

1.341480 

5.590168x10 5 

1.644927 

l.OOOOOOxlO 14 

10 7 

1.341480 

3. 162277xl0 17 
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Table 1 (Continued) 


p = 3.333333, m = 0.3 


p = 5. 000000, m = 0. 2 


Z(N,p) 

N 

N 

Z(N,p) 

NP 

1.099213 

1.007937x10 

wmm 

1.031250 

3.200000x10 




1,035365 

2.43 xlO 2 



4.00 

1.036342 

1.024 xlO 3 

1. 139414 

2. 1 37470x1 0 2 

5.00 

1.036662 

3.125 xlO 3 



6.00 

1.036790 

7.776 xlO® 



7.00 

1.036850 

1.6807 xlO 4 



8.00 

1.036880 

3.2768 xlO 4 

1.45586 

2. I54435xl0 3 

10 

1 .036907 

l.OOOOOOxlO 5 

1.46984 

2.171534x104 

2x10 

1.036926 

3.200000x106 

1.147310 

4. 605039x1 0 5 

5x10 

1.036927 

3. 124999x10® 

1 . 147346 

4.641588x10^ 

10 2 

1.036927 

l.OOOOOOxlO 10 

1 . 147353 

4. 678427x1 0 7 

2xl0 2 

1.036927 

3. 200000x10* 1 

1.147353 

9.921255x108 

5xl0 2 

1.036927 

3. 125000xl0 13 

1 . 147353 

3.045510xl0 9 

7xl0 2 

1.036927 

1 .680700x10 14 

1 . 147353 

9.999998xl0 9 

10 3 

1.036927 

l.OOOOOOxlO 15 

1.447353 

1.007937xl0 n 

2xl0 3 

1.036927 

3.200000x10 16 

1.147353 

2. 137469x10 12 

5xl0 3 

1.036927 

3. 125000X10 1 3 

1 . 147353 

2.154434x10*3 

ioj 

1.036927 

l.OOOOOOxlO 20 

1.147353 

2. 171 533x10*4 

2xl0 4 

1.036927 

3. 200000x1 0 21 

1 . 147353 

4.605039xl0* 5 

5xl0 4 

-1.036927 

3. 125000xl0 23 

1 . 147353 

4. 641588x10*5 

10 5 

1.036927 

l.OOOOOOxlO 25 

1 . 147353 

4.678428x10*7 

2xl0 5 

1.036927 

3. 200000x1 0 26 

1 . 147353 

9.921253xl0* 8 

5xl0 5 

1.036927 

3. 125000xl0 28 

1 . 147353 

9.999997xl0* 9 

10 6 

1.036927 

l.OOOOOOxlO 30 

1 . 147353 

1 . 007937xl0 2 * 

2xl0 6 

1.036927 

3.200000x10® 

1 . 147353 

•2.137469xl0 22 

5xl0 6 

1.036927 

3. 125000xl0 33 

1.147353 

2. I54434xl0 23 

10 7 

1.036927 

l.OOOOOOxlO 35 


P = 

o 

o 

II 

•E 

o 


p(N,p) 

NP ' 

N 

1 . 000977 

1.024 xlO 3 

2.00 

1.000993 

5.9049 xlO 4 

3.00 

1.000994' 

1. 048576x10*6 

4.00 

1.000995 

9.7656 25xl0 6 

5.00 

1.000995 

6.046619xl0 7 

6.00 

1.000995 

2.824752x108 

7.00 

1.000995 

1.073742xl0 9 

8.00 
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Appendix 2. 1 


Consider the low-pass filtershown in Figure 2.1A 


fteompOtTl+i^^T!- 
sampled signal 



comp^J exp 
continuous signal 


Ti 

J 

tTiGsBH 





-E 

1 B 


(b) 

FIGURE 2. 1A (a) Reconstruction filter 
(b) Gate function 


- To obtain the output one takes the inverse transform of the transfer function 
[jiGgg (w)]and convolves with thejnput. Thus 

[ W>] exp - £ Pco m p( kTl+ ixp 5 < t - kT ‘- T) ‘ Sa < B,) < 2 ' ,A) 

where 

*means convolution and Sa(Bt) = sin Bt/Bt is the inverse transform of the 
transfer function or the gate function. Now, since 

6(t-kT i ~ t) * S a(Bt) = Sa jji(t-kTi-T)] 

Equation (2. 1A) becomes 

pcompto] = F[ t opmp( kTl+r )] e xp S9 [ B(f ' kTl ' T) ] which i$ 


Equation (2.3). 
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Appendix 2.2 


Find the mean square value of e(t), where 


’-*(>) = 


exp 

4 ; r/ ra 


T — »eo T : T/2 Vk1L' coni P' 


exp 


- s(kTi+T)J 


(2.2A) 


,(kTx+T)J 

•)J Sa[B(t«kTi-T^ dt . 

Various sampling functions appearing in the summation in Equation (2.2A) 
are orthogonal, i.e. 

r 00 r , -i r , n jy B for m=n 

j^Sa [B(t-mTi-r)JSaLB(t-nTi-T)jdt = | 0 for m * n ( 2 . 2 . 1A) 

Therefore, after changing the operation of integration and summation in 
(2.2A) one obtains 


9 


Sfl 3 [B(t-kTi-70] dt 


* (t) y f?=°mP (kTl+T) ]e=<p -sO'Ti-M-)} 3 

T/2 

J Sa s rB(t-kTx-T)l dt 
-T/2 

But from (2.2. 1 A) 

T/2 

It J* Sa 2 |B(t-kTi-T)| dt = Tl/B 
-T/2 


then (2.2.2A) becomes 


(2.2. 2A) 
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Appendix 2. 
But since B 


(Continued) 


2TTf 

o 

e3(t) = wr f{pcomp( kT i +r )] exp -s(k T i+r)J 2 , which is (2.6), 
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Appendix 2.3 


Show that G(v) s [M'(v)j .p where G(v) and M(v) are the moment generat- 
ing functions of Gaussian and uniform distributions respectively. 

Proof. 

mgf of (x) = f F exp (vx)l p(x) dx (2.3.1 A) 

loo *- 

thus from (2.3. 1A) 

G(v) = expjjnv + v 2 O' 3 /2~J 
and for m=o, cr 2 = A 3 / 12 

G(v) = exp[(A s /I2)(v s / 2 )] 


= f [(vA/2) a 1/6] k 1A I , 

k=o 


(2.3.2A) 


also 

[M(v)] unlf = sinh v(A/2) /v(A/2) 

= f [v(A/2)] 2k l/(2k+l) I , (2.3.3A) 

k=o 

Now, if one compares the sums (2.3.2A) and (2.3.3A) it is obvious that 
[v(A/2)] 2k l/(2k+ixr * [( v A/ 2) 8 1/6] k 1/ki 

,thus 

G(v) *[M(v)] unIf 
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Appendix 2.4 

Find the value of v that would minimize G s (v) e -va = exp|(k/2)(A s /l2) 

v 3 -av j . (2.4A) 


Solution: 


Minimizing In-fp^y) e jwlll also minimize G s (v) e va . 


Thus 


In [g s (v) e" va ]= ln[G s (v)J- va 

(2.4. 1A) 

taking the derivative of (2.4. 1A) 


d/dvjjn G s (v) e _va ] = jj/G s (v)Jd/dv [p s (v)J- a 

(2.4.2A) 

Equating (2.4.2A) to zero. 


d/dv[G s (v)] = a G s (v) 

(2.4.3A) 


v must be chosen such that (2.4.3A) Is satisfied. Putting G s (v) = exp 

[(k/2)(A s /12) v s ] into (2.4. 3A) 


one gets 

k(A 2 /l2)v exp [(k/2)(A s /12)v 2 ] = a exp[(l</2)(A a /12)v 3 ] 
and k (A 3 / 12) v = a 

or v = (q/k) (12/A 3 ) 


which is (2. 14). 
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Appendix 3. 1 

Prove that the sum of uniformly distributed phase phasors is itself a uniformly 
distributed phase phasor. 

Proof: 


LetRej®= 2 Au.e'^k 
k=o 


where 


(A^) are amplitude distributions such that the central limit theorem is 
satisfied. That is, no one of the distributions of A^ is dominant,and 
(G^) are the uniformly distributed phases. 


n 


If n is large, then by the central limit theorem R x = £ A^ cosG^ and 
n k =0 

Ry, =^S Ak sin 0k are Gaussian with zero mean and variance n^j^. Since 

R and R are orthogonal they are uncorrelated. The joint distribution is found as 


’X 

follows: 


p(R,0) = (R)p(R x , R y ). 

The two-dimensional Gaussian distribution is given by 


(3.1.1A) 


p(R R ) = -L_ e -(Rx+Ry)/20-‘ 
P IK X , Ky) e 


where = (l/2)n < A| > .. 

l> 

Now, from (3. 1 . 1A) one gets 


_ __R_ -R s / 2 cr 3 


p (R, 0) = 


2TV 


(3.1.2A) 


(3. 1.2A) is integrated with respect to R to obtain -p(0). 

P (9) = £ p(R,0)dR = -^rj J ^^dR 


p '(e) - J_ 

2TT 


(3.1.3A) 
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Equation (3. 1.3A) shows that ReJ® Is a uniformly distributed phase 


phasor . 
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Appendix 4. 1 

Let n Q * n p exp |” . 

Find the distribution of n Q at a given time and if the distribution of n is known. 

F 

Solution: 

At a given time let expj" = k where k is a constant apd let p(np) 

be defined by Equation (4.5). Now then, 


n 0 = k n p 


but 


or 


P(n 0 ) d(no) = p(np) d( np ) 
pW = P(np) | 


then 


p(no) = 1/k p(np) 

which proves the statement made in page 32. 
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Appendix 4.2 

Given n p = , where A i s Gaussian, find the distribution of n p . 

Solution: 


P0O 


I 

(or) /2TT 


exp 


(A-M ) 2 



and since p (np) d(np) = p(A) dA 

or p(np) = p (A) dA/d{n p ) 

but d(n p ) = e^dA =|^ n ( n p)J dA = n p dA 

then (4.2.2A) becomes 


(4.2.1 A) 


(4.2.2A) 


p( n p) = 0/np) p(A) 
p(np) = (l/n p )p^(ln n^ 
or from (4.2. 1A) and (4.2.3A) 



(n p )a/2Tf eXP 



(4.2. 3A) 


which is Equation (4.5). 
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Appendix 4.3 

k . _ X t 

Let tk = £ T., where Tj are distributed identically and p(T j) = Xe 

i=l 

Then find p(t|<). 

Solution: 

The characteristic function of the random variable t - Tj is 
/%'“*> (Xe- X *) d t = rar 

O » 

The characteristic function of t^ is the product of the characteristic 

functions of the sum terms t = Tj . Then the characteristic function of t^ is 

x k 

chf. of t k = (jqjIEjfc (4. 3. ] A) 

Taking the inverse transform of (4.3. 1A) one obtains 


p(tk) r°° x k 


p(t k ) 


1 r a 

nr J 0 ^x^r 

X^'e^k 
(k-1) I 


d» 


which is Equation (4.8) 
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Appendix 4.4 

Let v = expjjj c/gQ, and the distribution of is p(t|<). 
tion of V, p(v). 

Solution: 

p(t k ) = xV' e- Xt l< /Ml 

and 

P(v) = P t[< (v) Jdt^/dvl 
since t k = a in v, then dt k /dv = o/v. 

The p(t|<) in terms of v is given by 



X k (alnv) k “ 1 e- Xfl!lnv 

IRTI 


X k (^lnv) k - 1 

\ V (k-1) I 


Then from (4.4. 1A) and (4.4.2A) 

nW = fa'/v'i X k (alnv ) k_1 

pw w } ww~jtr 


p(v) = 


X k Q k (| n v) k ~ ] 

(k-l)l v X0!+1 


Find the distribu- 


(4.4. IA) 


(4.4.2A) 


which is Equation (4.8. 1). 
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Appendix 4.5 

Given n k = u/v, p(u) and p(v) find p(n k ). Assume u and v are inde- 
pendent. 


Solution: Let n k = n k (u,v) , m k = v and their inverse functions are 
u = u(n k , m k ), v = v(n k , m k ) . 

Since the following relation holds, 

p(u,v) dudv = p(n k , m k ) dn^d^ 


then 


P( n k' m k^ = p ( u ' v ) 


d u d v 

d n k d m k ' 


(4.5. 1A) 


but 


dudv 


3 (u,v) 

dn k dm k 


d ( n k' m k) 


Therefore one first finds the Jocobian.to be: 


S(u,v) 
d ("k' m l<) 


V o 

3 


- u / n k 1 

The Equation (4.5. 1A) becomes 

pOv m k ) = vp (u/v) 

= v PuvK' m k^ (4.5.2A) 

Now, since u and v are independent 
p(u, v) = p(u) p (v). 

Also noting that dv = dm k , upon integrating both sides of Equation (4.5.2A) 
one gets 

JV(i\/ ™ k ) dm|< = J vp(u) p(v) dv (4.5.3A) 


1 
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Appendix 4.5 (Continued) 

Left side of Equation (4.5.3A) is p (nk). Also replace u= n^v. Now, if 
v = expj^t^/ofj and o ^t^oothen 1 £00 . Therefore Equation (4.5.3A) becomes 

fOO 

P (nk) = | V p(v) P y (n k , v) dv (4.5.4A) 

From Equation (4.5) and (4.8. 1) p (J (n^v) and p(v) are obtained. But first 
the following transformations are made 

In v = x, then d v = e x dx and when v - 1 , x ~ o and v = °9 x = °°. 


Then 


X k Q k x k -’ 

PM 


(4.5.5A) 


and 


exp 


r- (lnn| c *x-m) 3 1 (4 . 5 ^ A) 
L 2 a 2 -I 


p p (nkv) = ^F7W 

Placing the values of p(v) and P u (n k , v) in (4.5. 4A) from (4.5.5A) and (4.5.6A) 
one gets 

^ oh l , e \_i r (In u k +x-m) 3 l 
p< nk > = (k-i)ioh k /2i 4 x sx p L-°* x * J dx 


this is Equation (4.9). 
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Appendix 4.6 

Show the. < g o v ») • > - jf? <h k 2 > . 

Proof: 

Let S = ReJ 0 = £ n, e^ k (4.6. 1A) 

k=o k 

The mean-square value of the complex random variable S is <SS*>. Therefore, from 
(4.6. 1A) one has 

■^R 3 ^ —< ni e*^ k S > . (4.6.2A) 

k=o k |;= 0 1 

If one assumes and nj are independent and uses the fact that the average of the 
sum is equal to the sum of the averages, then 

<R S > = |~ 0 <n k n | e ^'^ < (4.6.3A) 

If the amplitudes of the phasors are independent of their phases, then (4-6. 3A) 
becomes 

<R S > = £ S <nun|><ei^ _c P|)> (4.6. 4A) 

k=o l=o K 1 

But, if the phases are uniformly distributed then 


,j(<Pk-'l , !> > = _L 

4TT 2 


jf ^ - ft 


for kM 
for k=| 


Thus (4.6.4A) is now 

~ n 

<R 3 > = S <nu> 
k=o k 


or from (4.6.2A) and (4. 6.5A) letting n = co one gets 


T/ ^ < nj < 2> = < f S n^J 2 > . 


(4.6.5A) 
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Appendix 4.7 


Evaluate the following integral 

_ ^ r” 2 r® 0 

^1 > = J nr — J > 

k o k (k-])lffn k /¥ o 


J x k ~ ] expfj-aXx 


w (In nL+x-m)' 


dxdni. • 


(4.7.1 A) 


Set In n^v and interchange integrals over x and n^, then integrate with respect to 
n^. Since dn^ = e v dv and when n^ = o, v = -sQand nj,, = es , v = Q0 , the Equation 
(4.7. 1A) becomes 


<n, S > 


CO, , , so 

■’! x k -V X “ x dxJ' 

X=0 


P - (y+x-m) 2 

L 2<J 3 _ 


e v dv , 


<n k 2 > = 


/V^dx/ 


exp [~ ] dv. (4.7.2A) 

Now, if one adds and subtracts (x-m-20 3 ) 2 from the numerator of the exponent of 
the integral with respect to (v) and considering that integral only, then one gets 

/°exp[ ~ fc+Cx-m^j] 3 + 4a 3 [x-m-o 2 ] }l ^ 

ioo L 2a 3 J 


~ exp 


4c/ 3 ( x-m-ct 2 ) f - ‘[v+(x-m-2a) 3 ] 

“Jlso 


dv (4.7.3A) 


The integral in (4.7.3A) is easy to evaluate and it is equal to a/ 2TT . Thus 


(4.7. 3A) is now equal to 


ct/2TT 


-4 c/ 3 (x-m-o 3 ) 


(4.7.4 A) 
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Appendix 4. 7 (Continued) 

Returning to Equation (4.7. 2A) and replacing the integral with respect to 
(v) by its value from (4.7. 4A) one obtains 


' n k 




or 


(k— 1)1 ^=o 
»kj< 


exp 


-4 a 3 (x-m-o^) 


L 2a 


dx 


<111' 


> = >WL r e 2(iirt0^)l r*° x k-\ e -Q«*2h 


(k-l)I 


dx . (4.7.5A) 


Le ' 'JJ 

x=o 

Let (Xott-2)x = T and dr - (Xa+2) dx. When T= o, x = o and T -< 20 , x = cc. 
Equation (4.7.5A) becomes 


>=^[.2(^)1^ [-1 


<n k > “(Fiyrb 


k-i 


or 


<n k 3> = 


J .%=o L(Xa+2) 

7 Wif~ VT6T - 


e“ T Xa+"2 


dT 


X k a k r- 2 ^ 0 ^ 00 


(4.7.6A) 


(k- 1)1 (Xa + 2) k 

But the integral in (4.7.6A) is the Gamma function T (k) and since T(k) * (k— 1) I , 
one has 


<n k > = 


Xk^k e 2(i 

(Xa+2) k 


which is (4. ]2). 
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